Heat Dissipation from Brownian Particles under Hydrodynamic Interactions 
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We study the non-equilibrium thermodynamics of single Brownian macromolecules immersed in 
water solvent. They are under both a hydrodynamic interaction and a feedback control on their 
movement by an external agent. The macromolecules are described by a Langevin equation with a 
multiplicative noise. Work done by the macromolecules on the water solvent is dissipated as heat. 
Thus, the heat is expressed as the integration of an interacting force between the macromolecules 
and the water solvent along the position space trajectories of the macromolecules. This integration 
is stochastic due to the Brownian motion of the macromolecules. We show that the Stratonovich 
prescription of the integration is the unique physical choice. We also show that thermodynamic 
quantities such as heat, work, and entropy production, are derived without any ambiguity if both a 
diffusion matrix and external feedback control are known as priori. 
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PACS numbers: 



I. INTRODUCTION 



Brownian dynamics has been widely applied to 
nano-scale (macromolecular) driven systems such as 
AFM/DFM cantilevers P,[3|3, motor proteins 4], ion 
channels and tribology p| . These systems are mainly 
in non-equilibrium driven by external agents. The de- 
sign of efficient nano-scale systems requires mesoscopic 
non-equilibrium thermodynamics. We have introduced 
mesoscopic heat, work, and entropy [1,Q,IEI2]- We have 
provided a rigorous thermodynamic analysis on a molec- 
ular refrigerator composed of both a Brownian harmonic 
oscillator and an external control agent who actively re- 
duces the thermal fluctuation of the oscillator 0, Q ■ We 
have assumed that the interaction between the refrigera- 
tor and its surrounding is expressed as linear friction and 
Gaussian white noise. 

In this manuscript, we extend our thermodynamic 
analysis to study Brownian particles under multiplica- 
tive noise. When polymers are in solvent, they are under 
hydrodynamic interactions fldi ITU . Their Brownian mo- 
tions are well described by a state-dependent diffusion 
process, i.e., multiplicative noise. Such nois e ap pears in 
other diverse fields 12J, e.g., motor proteins [13 and reg- 
ulation of gene expression Most of numerical and 
analytical analysis on the systems under the multiplica- 
tive noise have been focused on their stochastic dynamics 
rather than on their thermodynamics. To our knowledge, 
the quantitative thermodynamic analysis is absent due to 
the following two reasons. 

The first reason is the lack of physical concept in meso- 
scopic heat dissipated from a Brownian particle. The 
mesoscopic heat is the mesoscopic work done by the 
Brownian particle on the solvent, so it is expressed as 
an integration of an interacting force between the par- 
ticle and the solvent along its position space trajectory 
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of the particle: Q{t) = — J^~^ dx{s) ■ Fp5(x(s), v(s)) 
with x(s) (v(s)) is the position (velocity) of the particle 
at time s and Fps is the force done on the particle by 
the solvent molecules and t is time. We have adopted 
without rigorous justification that the above integration 
along the trajectory is done with the Stratonovich pre- 
scription [.ll It! lln^. In this manuscript, we will show its 
justification. 

The second reason is that the mesoscopic heat needs 
another prescription in Fp5(x(s), v(s)). The phase 
space trajectory of the particle is different for differ- 
ent prescriptions of the stochastic integration involved 
in v(t) = (isF7'(x(s), v(s)) with unit mass and with 
the total force on the particle Ft- This means that 
Fp5'(x(s), v(s)) is also dependent on the prescription in 
V. However, the dependence on the prescription is shown 
to be removed under a generalized Einstein relation (16iJ . 
Then, can one express heat in a form independent to the 
prescription in v under the relation? We provide such 
expression of heat from energy balance. 

We also answer a fundamental question, "Does detailed 
balance guarantee equilibrium steady state?" Recently, in 
Brownian systems without any multiplicative noise, the 
detailed balance has been shown to guarantee the systems 
to reach at equilibrium steady state 0, . However, 
as presented here, in systems under multiplicative noise, 
this is not true. 

This paper is organized as follows: from Sec^ to 
Sec lVIl we study a model of macromolecules in closed 
heat bath, where the system reaches at an equilibrium 
steady state. In SecJ^ a model of the macromolecules is 
introduced using both a Langevin equation and its corre- 
sponding Fokker-Planck equation. Mesoscopic heat dissi- 
pated from Brownian particles is introduced from meso- 
scopic energy balance with Stratonovich prescription of 
stochastic integration involved in the integration of force 
along the past spatial trajectories. In Sec lIIII the general- 
ized Einstein relation is derived to guarantee a Maxwell- 
Boltzmann distribution in an equilibrium steady state. 
We show that the relation makes the mesoscopic heat in- 
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dependent to the prescription of stochastic integration of 
the Langevin equation. In Sec llVI using the definite form 
of heat dissipation, we derive entropy balance and show 
the H- function, i.e., free energy, becomes maximized in 
equihbrium state. In SeclVland lVIl we investigate the re- 
lationship among detailed balance, an equilibrium state, 
and the H-function. In Sec lVIII we consider a driven sys- 
tem by feedback controls and reformulate all the previ- 
ous results for a non-equilibrium steady state. Finally, in 
Sec lVIIll we prove that the Stratonovich prescription of 
stochastic integration involved in the definition of meso- 
scopic heat is the unique physical choice. 



II. A MODEL OF SINGLE MACROMOLECULES 
UNDER MULTIPLICATIVE NOISE 



We should note that Eq.Q is meaningless without in- 
tegration prescription since a pulse in white noise causes 
a finite jump in v and then the value of v in r(v) needs 
to be prescribed. Two popular prescriptions by Ito and 
Stratonovich have been widely used. The Ito prescrip- 
tion takes the value of v in r(v) before the jump in v 
caused by the white noise and the Stratonovich prescrip- 
tion takes it as the middle point value of v before and 
after the jump. A Langevin equation with each prescrip- 
tions can be converted into Langevin equations with the 
other prescriptions 20]. For the ease of calculation, we 
convert Eq.JQ) into a corresponding Ito-prescribed form, 



f' + f(v).eW, 



(3) 



where 



We consider a closed system composed of both 
a macromolecule and its surrounding isothermal wa- 
ter solvent. Following the general theory of poly- 
mer dynamics |10j, the macromolecule itself is de- 
scribed by a bead spring model with Hamiltonian H = 

2 

^"2;^ + ?7i„t(xi, • • • , xat) where and are the 3-D 
coordinate- and momentum-vectors of the a-th bead of 
the macromolecule, respectively, and Umt is an internal 
potential of the macromolecule. The random collisions 
between water molecules and the beads are modeled by 
a multiplicative noise and frictional force f(vi, • • • , vjv) 
with Vi the velocity of the i-th bead. This is because the 
bead is assumed to be much larger than water molecules 
in heat bath and thus the time scales of the two can 
be separated 0, 0|. For simplicity but without los- 
ing any generality, we consider a macromolecule simply 
as one point-like bead. Its internal energy H becomes 
H = with a unit mass. The dynamics of the bead 
can be described by the following Langevin equation. 



/;(v)^/,(v) + af,,(v)a,ffe,(v). 



(4) 



dv 
'dt 



f(v)+f(v).CW, 



(1) 



where ^ is Gaussian white noise satisfying {£,{t)i£,{t')j) — 
5ij5{t—t') with i = x, y, 2; in 3-D. Note that the noise term 
has a state-dependent amplitude, r(v), and such state- 
dependent noise, r(v) -^j is called a multiplicative noise, 
which incorporates hydrodynamic interactions. For ex- 
ample, spherical hard particles with finite radius R un- 
dergoes hydrodynamic interactions of nonlinear fluctua- 
tion force in Oseen approximation [T9l |. 
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where C is the frictional coefficient due to the interaction 
between solvent and the particle, and p is the density of 
solvent, and v the modulus of v. The frictional force, 
f(v), is shown later to be given by Eq.Q) l^and H13|l if 
r is known. We will discuss the above example more in 
detail in Sec. IIIII 



with a = (1/2) for Ito (Stratonovich)-prescribed Eq.([3l. 
Note that the Einstein summation rule is used. 

Let's consider energy balance. The change of mechani- 
cal energy of the macromolecule, dH{Xt,Yt), is the same 
as the work done on the macromolecule by all the external 
forces, i.e., dH{Xt,Yt) = {f'+T-^)odX , where o indicates 
that the stochastic integration is done in Stratonovich 
way. We will be shown in Sec lVIIll that the Stratonovich 
prescription for the definition of dH is the unique phys- 
ical choice. Since the internal energy changes by heat 
dissipation and absorption by the bead through interac- 
tion with the surrounding heat bath, we identify 0, Q 

dQ{Xt,Yt) = -dH{Xt,Yt) = -if + r-OodX. (5) 

This indicates how much heat is dissipated (absorbed) 
to (from) the surrounding water heat bath from (to) the 
bead located at (Xj, Yj) at time t during time interval dt 
for a stochastic process. Using Eq.©, we derive 



dQ 
dt 

■{'- 



■0, 



(6) 



where iJ^ = -v ■ f - \Tr[TT'^], and Eq.© is integrated 
with the Itq prescription. For the detailed derivation of 
Eq.®, see plj . 

The ensemble average of heat dissipated up to time 
t for a stochastic process, (5({v(s)};{0 < s < t}), is 
E[Q] = E[Hd{v{s))]ds. For a sufficiently small time 
interval (t,t + Ai), the average amount of heat dissipated 
is E[Hd\At. The heat dissipation rate {hd) at time t can 
then be defined as 

ha{t) = E[Ha{^m = j dv{-vf'-iTr[ff^]}P(v,t), 

(7) 

where /'(v, t) is a probability distribution function satis- 
fying a Fokker-Planck equation corresponding to Eq. (jSJ , 

r>P 1 

— = -d,d,{{TT^\,P} - mP) = CP. (8) 
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Eq.|(7I) implies fluctuation dissipation relation {hd{t = 
oo) = 0) in equilibrium as shown in Sec 11111 frictional 
dissipation from the bead to the heat bath is balanced 
by heat absorption by fluctuation from the heat bath to 
the bead. In addition, the formula of Eq.|(7|) is shown in 
Sec lVIII not to be changed in a driven system and to imply 
the breakdown of the fluctuation dissipation relation. 



III. GENERALIZED EINSTEIN RELATION 
AND HEAT DISSIPATION RATE 



In this section, generalized Einstein relation is pro- 
posed for the correct equilibrium steady state distribu- 
tion of the Fokker-Planck equation Eq.JHJ, i.e., Maxwell- 
Boltzmann distribution. This relation is shown to make 
the mesoscopic heat, Eq.®, independent to stochastic 
integration prescription of the Langevin equation, Eq.(^, 
and vanish at equilibrium steady state. In addition, this 
relation shows interesting information on the form of fric- 
tional force which includes (1) nonlinear frictional force 
stemming from hydrodynamic interactions, e.g . , dissipa- 
tive force in dissipative particle dynamics and fric- 
tional force in a Zimm model (10|] and (2) transverse force 
in vortex dynamics of homogeneous superconductors . 

By substituting Maxwell-Boltzmann distribution func- 
tion (-Pe(v) = Ce~^ with C normalization constant 
and with ks — I unit) into Eq.lO, we can find the form 
of frictional force f(v). The r.h.s. of Eq.® is simplified 
as 

ia,9,{(fF),,pj-9.(/;Fe) 



= di 
Therefore, 



-I 
2' 



/;(v) = ^a,(f(v)F(v)),, - l(f(v)F(v)),,| +5,:(v), 

(9) 

where b(v) is an arbitrary solution of di{bi{v)Pf.{\')) = 0. 

Now, by substituting Eq.© to Eq.||7I), heat dissipation 
rate hd{t) becomes 



hd{t) 



--Tr[rT^P{t). 



(10) 



In equilibrium, by substituting Pe (v) to the above equa- 
tion. 



hd{oo) 



dw 
1 



1 
2 



'(b-v}e, 



{rr^),jdj{v,Pe) 
1. 



UiUj 



Tr[rt^]}Pe - hv,Pe 



(11) 



where (•)£ means average over equilibrium distribution 
function Pe(v). The heat dissipation rate is expected to 
vanish in equilibrium, so we propose a generalized Ein- 
stein relation: 



Eq.Q and (b-v)e=0. 



(12) 



where b an arbitrary solution of di{bi{v)Pe{v)) — 0. 
Since all the above procedure can be reversed back, the 
generalized Einstein relation also guarantees Maxwell- 
Boltzmann distribution for closed systems. Furthermore, 
the relation lets heat dissipation vanish, entropy produc- 
tion vanish, and an average flux (v)e trivially vanish as 
shown in Sec II VI 

Under the generalized Einstein relation, the Fokker- 
Planck equation Eq.® becomes independent to the 
choice of integration prescription of the Langevin equa- 
tion, i.e., the constant, a HI?. The definition of the meso- 
scopic heat Eq. (|3J) derived from the energy balance makes 
Eq.(|5Jl a- independent since /' becomes a- independent 
from the generalized Einstein relation (See Eq.@). This 
makes thermodynamic quantities such as entropy pro- 
duction, work and internal energy a-independent. We 
conclude that when a Langevin equation with multiplica- 
tive noise is given, we can construct mesoscopic thermo- 
dynamics independent to the prescription of the stochas- 
tic integration in the Langevin equation as long as its 
steady state follows Maxwell-Boltzmann distribution. In 
Sec lVIII we consider a non-equilibrium system where the 
generalized Einstein relation still holds. Such system will 
be shown later for both the Fokker-Planck equation and 
the mesoscopic heat, Eq.®, still to be independent to the 
stochastic integration prescription of its Langevin equa- 
tion. We reach at a more general conclusion that as long 
as the generalized Einstein relation holds, one can con- 
struct mesoscopic non- equilibrium thermodynamics inde- 
pendent to the prescription of the stochastic integration 
in the Langevin equation. The validity of the generalized 
Einstein relation and the proposed heat must be tested 
by measuring thermodynamic quantities using molecular 
dynamics simulations. 

Note also that since Fokker-Planck equation Eq.© 
and the mesoscopic heat equation Eq. are expressed in 
terms of diffusion coefficient FF"'", one can numerically or 
analytically predict all the thermodynamic quantities by 
measuring the diffusion coefficient. For example, poly- 
mers in solvent under hydrodynamic interactions (See 
Eq.(|2J)) undergoes frictional force /', 



C .1 ^ 3 pi? 
--..(1 + --.), 



(13) 



and heat is dissipated on average by 

^2 3r, 



hd{t) 



dv^C(- 

lP^Cvi-T+-) P(v,i). 
4 77 4 



(14) 
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The heat dissipation rate, as expected, vanishes at equi- 
hbrium; Substituting Pe into Ea. H14|) . the first term in 
h(i vanishes from equi-partition theorem and the second 
term vanishes since the order of v is odd. Ea. (|13|) and 
(|14|l become useful in a driven system, where one can an- 
alyticaUy predict average heat dissipation rate in steady 
state once the steady state distribution is known, or if 
not known, at least one can get numerics by Eq.(|SJ|. 

The frictional force term 6(v) can be transverse force 
to velocity v. One of the concrete example is vortex dy- 
namics in homogeneous superconductors [22|. This vor- 
tex system is a closed system since a transverse force 
&(v) on vortex is applied by magnetic field produced by 
superfluid circulation. 

If a macromolecule is immersed in a general isotropic 
frictional medium 23] such as the frictional force f'(v) is 
expressed as f'(v) — —j{v)-v and the fluctuation force is 
as Tij{v) = Sijr{v), the frictional force f becomes 



/:(v) - (- 



T{vf 1 dT{vf 



(15) 



2T 2v dv 

where we used the fact that b vanishes from one of the 
generalized Einstein relation (b • v)e = since b cannot 
be parallel to v. 

IV. ENTROPY PRODUCTION RATE 

In a non-equilibrium system, entropy is produced (cre- 
ated) from its inside. For example, let two heat baths 
having different temperature connected together. Then, 
the total entropy change of the two heat bath is dS — 
(i(3i^2(l/?2 - 1/Ti) > 0, where dQi^2 is the heat 
transferred from heat bath 1 to heat bath 2 and 71(2) 
is the temperature of heat bath 1(2). In equilibrium, 
entropy production vanishes. In macromolecular system 
immersed in solvent, the macromolecule is not in a quasi- 
static process, while the heat bath is because the macro- 
molecule has a small number of degrees of freedom; there 
is no boundary layer that the fluctuation caused by in- 
teraction with heat bath disappears. The entropy change 
of heat bath, dSH, is dQu^H /Th, where dQ^^n is 
the heat transferred from the macromolecule to the heat 
bath and Th is the temperature of heat bath. However, 
the entropy change in the macromolecule, dSu, is not 
dQu^M /Tm, where Tm is the temperature of the macro- 
molecule if it can be defined. How can one construct 

We consider Gibbs entropy, 5*4/ (t) = 

-/dvP(v)lnP(v) 11 m and P = Tr- It wifl 

be shown in this section that entropy balance is 
expressed as. 



d{SM{t) + SH{t)) 

dt 



Spit) > 0, 



where 



ep{t) = ^J H,(^)J^(^)dv, 



(16) 



(17) 



and H is a thermodynamic force defined as the sum of 
the second term of the frictional force expressed in Eq. © 
and Onsager's thermodynamic force: 

H,(i) = -(l/2T)(rr^)y(i;, +Pa,lnP(t)) 

and J{x,y,t) is a thermodynamic flux corresponding to 
the thermodynamic force H and is deflned as: 

Mt) = -{v^ + Td,lnP{t))Pit). 

Ji is the sum of both the velocity of the macromolecule 
and the diffusion flow in momentum space. Note that, 
as in macroscopic non-equilibrium thermodynamics |26| |. 
ep{t) is expressed as a product of thermodynamic force 
and its corresponding flux. Note also that ep{t) is always 
non-negative. This implies the 2nd law of thermodynam- 
ics. In the equilibrium steady state, the entropy produc- 
tion vanishes: the macromolecule can be considered to 
be in quasi-static process and Tm well defined to be P. 

Let's start the derivation of Ea. (|16|l . P denotes heat 
bath temperature. For the ease of calculation, we intro- 
duce S = (i/2P)rr^. 



dSM 
dt 



dt 



P In Pdv 



dP 
'dt 



In Pd-v 



= - J d,i-nP + Td,{E),,P + TE,,d,P) 
X In Pdv 

= J i-n + Tdj (S)y + PS,, a, In P)d,Pdv 
= J {vj + Tdj In P)diPdv - J b^Pdv 
= ^ y {vj + Tdj In P) {v, + Td, In P)Pdv 

^^J{vJ+T^JlIiP)v,Pd^, 

bAPdv, (18) 



where the first term is entropy production rate ep{t) and 
the second and the third are the entropy change in heat 
bath due to heat dissipation from the macromolecule. 



dSH{t) 
dt 



j; J Mt){~E,,Vi)dv + J bAPdw. 



(19) 



dSu (t) I dt can be simplified as 
dSnit) 



T 



TEijdj\nP)v,Pdv 



- J-in-0,(TE.,)^b. 

-T{dA) 

= J (-/>. - Pr[PS,,])Pdv + (b • v) - T{dA) 

= hd{t) + {vA-TdA). 



Now, we have an unexpected extra term and this term, 
however, is proved to vanish: b is an arbitrary solution 
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of di{biPe) = 0, which is equivalent to Tdibi — Vibi = 0. 
Therefore, 



dSnit) hd{t) 



dt 



T 



(20) 



This confirms that the heat bath is in quasi-static pro- 
cess. 



V. DETAILED BALANCE AND POTENTIAL 
CONDITIONS 

A system is called to be microscopically reversible 
[2^ I23, when the microscopic equations of motion 
governed by a Hamiltonian is invariant under time re- 
versal operation. From this microscopic reversibility^^de- 
tailed balance is derived with ergodic hypothesis |26ll28l| . 
We are interested in a closed system of many classi- 
cal particles, comprising solvent molecules and macro- 
molecules, of which the equation of motion satisfies the 
microscopic reversibility. Therefore, the detailed bal- 
ance is expected to hold in mesoscopic description of the 
Langevin equation Eq.©. 

In Brownian systems without any multiplicative noise, 
the detailed balance has been shown to be a sufficient 
condition for equilibrium steady state 0, ^3- However, 
as rooted from the microscopic reversibility, the detailed 
balance will be shown in this section to be just a neces- 
sary condition for equilibrium steady state. 

Now, let's derive well-known potential conditions pflj ] 
in discrete time and continuous space, which can be triv- 
ially extended to the case of continuous time and con- 
tinuous space. The time increment is denoted by e and 
t„j = me with m an positive integer. When the system is 
Markovian, we can introduce transfer matrix, r({Ci}), 
satisfying = f[{Ci\)\P)t^. The detailed balance 

[28| is expressed as, 

(v„+i|f({a})|v™)(v„|P;{CO)e 
= (-v,„|f({Qa})| - v™+i)(-v„,+i|P;{e,C,})e,(21) 

where is 1 for a constant coefficient, C^, if it is symmet- 
ric under time reversal operation, —1 if anti-symmetric, 
and other value if neither symmetric nor anti-symmetric 
determined from microscopic origin . denotes v 

at time along a process by transfer matrix T{{Ci\). By 
integrating out in Eq.|(2U, we get (v|P)e = (— v|P)e, 
where \P), = |P;{CJ)e, |P)e = |P;{e.CJ)e. Therefore, 
Ea. (|^ becomes 

(v,„+l|f({a})|v,„)(v™|P)e 

= (-v™|f ({e,a})| - v„,+i)(v„,+i|P)e. (22) 

The transfer matrix is related to the linear operator C 
of Fokker-Planck equation Eq.JSJ as T = / -f tC. Now, 
Ea. (|22|l is re-expressed as 



where T{{eiCi}) = / + e£ is used. Ea. H23|) becomes 

1 



Cl5{v-v')P,{v') 



-C-J{v - v')P,{v') 



/^2 



1 



^e(^) 

We find symmetry in the operator C 



Peiv) 

Z^,Pe{v)5{v-v')P,{v'). (24) 



1 



Pe{v) 



C-,Pe{v). 



(25) 



FromEq.®, £t = ^A,jdidj + f[d,, where i = fF. The 
r.h.s. of Ea. lpHj) is expressed as 

£„„Pe(v) 



Pe{v) 

= Yfi^d,d,A.,,{-v)P,{v) dJi{-v)PAv)} 

= ^A,,i-v)d.d, + l-{d,A,{^v)Pe)d, + :n{^v)d, 

+Y^{ld.^iA,,i-v)Pe+dJU-v)Pe), 

where A{v) = Aiv;{e,C,}) and f'{v) = /'(i;; {e,CJ). 
Finally, by matching term by term, we derive a set of 
conditions well known as potential conditions l2^, 

9anPe(v) = (fF),^.^h/j(-v;{6,a}) + /j(v) 

-dk{TT^)kj] (26) 

f(v;{a.})f^(v;{Q}) 

= f(-v;{e,a})f^(-v;{e,a}). (27) 

The detailed balance Ea. H22|) . the symmetry relation in 
operator C Eq. H25|) , and the potential conditions Eq. H2t)|) 
and H27|) are all equivalent in Markovian systems with 
Pe(v;{a}) = Pe(-v;{e,C,}) 29, 30]. 

By substituting Eq.Q into Eq.^^ and ^7^, the po- 
tential condition becomes 

T 

(28) 



a,lnPe(v) 



+ {rr%'{-b,{-v;{e,a}) + b,{v)} 



{v\£^\v'){v\P),^{-v\£\^v'){v'\P), 



(23) 



f(v; {C,})f^(v; {a}) = f(-v; {e,a})f ^(-v; {e.G,}). 

(29) 

We can find the property of each terms of f ' under time 
reversal operation from Eq.Q, and it^ : b(v) 

is symmetric and the rest of terms in Eq.® are anti- 
symmetric. If b(v) is odd (even) in velocity, then its co- 
efficient must be anti-symmetric (symmetric) under time 
reversal, e.g, transverse force in vortex dynamics is odd 
in velocity and its coefficient, magnetic field, is anti- 
symmetric under time reversal operation j22| . For the 
rest of terms in Eq.@, however, the coefficients of terms 
odd (even) in velocity are symmetric (anti-symmetric). 
We can find time reversal properties of all the constant 
coefficients in f ' from the detailed balance condition and, 
however, this condition does not apply any further re- 
striction on the form of the frictional force. 
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VI. DETAILED BALANCE V.S. = 

In the region where the generahzed Einstein relation is 
vaUd, if entropy production vanishes, equihbrium state 
reaches since Cp = is equivalent to Vi + Tdi InP(t) = 
from Ea. (|17|l and this equation guarantees P{t) to be 
Maxwell distribution, P^. Therefore, Bp = is equiva- 
lent to equilibrium 3]. Does detailed balance guaran- 
tee that system reaches in equilibrium? No. The de- 
tailed balance is necessary condition on equilibrium from 
Ea. (|28|l and (|29|l since time reversal property of trans- 
verse force, b(v), is not known as priori. Only when 
the transverse frictional force is symmetric under time 
reversal operation, the detailed balance guarantees equi- 
librium. In summary, the relation among equilibrium, 
zero entropy production, and detailed balance is symbol- 
ically expressed as 

Equilibrium = [cp = 0] C Detailed Balance. (30) 



VII. A DRIVEN SYSTEM: NON-EQUILIBRIUM 
STEADY STATE 



In the previous sections, we constructed mesoscopic 
thermodynamics for a closed system, which has an equi- 
librium steady state. In this section, we extend all 
the previous analysis to a driven system, which has a 
non-equilibrium steady state. We consider that macro- 
molecules are under hydrodynamic interaction and are 
subject to a feedback control by an external agent. As 
before, the hydrodynamic interaction is modeled by an 
Oseen tensor. The feedback control is modeled by a non- 
conservative force, g(x) 31]. We assume that the driven 
system is near equilibrium in the sense that the gen- 
eralized Einstein relation Ea. H12|l still holds. Now, the 
non-conservative force, g(x), is added in the Langevin 
equation for a closed system, Eq.lQJ: 

^=g(x)+f(v)+f(v).C(0. (31) 

The corresponding Langevin equation in Ito-prescribed 
form becomes 



dv 



= g(x) + f'(v) + f(v).e(t). 



Energy balance is expressed as dH — dW — dQ, where 
dH is the change in internal energy that is work done 
by all external forces, i.e., dH = [g -I- f ' -I- r(v) • £] o dX 
and dW = g(X) o dX is work done by the control force 
g. The heat dissipation dQ from the macromolecule to 
the surrounding heat bath becomes the same form as in 
a closed system: dQ — — (/' + E • ^) o dX. Fokker-Planck 
equation is changed to 



dP 
'dt 



Eq.@, 0, ®, iQll, (ini) and (EOl) are not altered. Its 
proof is just book-keeping of ||21|| and Sec II VI entropy bal- 
ance equation is not changed. However, the steady state 
is not in equilibrium and the entropy production becomes 
positive, which means that the total entropy of both the 
macromolecule and heat bath constantly increases. In 
other words, there is net positive heat dissipation from 
the macromolecule to the heat bath. 



VIII. THE DEFINITION OF HEAT WITH 
STRATONOVICH PRESCRIPTION 

As we discussed in SecEl we have used Stratonovich 
prescription for the definition of dQ: dQ = — (f + F • 
^) o dX. It will be shown that the diffusion coefficient 
matrix, FF"^, becomes traceless, which is unphysical for 
diffusive systems, if we use other prescriptions in dQ. 

Let dQ = — (f -I- F • ^) • c?X, where • indicates the 
stochastic integration is not in Stratonovich way. Eq. © 
is changed to Ito-prescribed stochastic equation with 
multiplicative noise. 



dQ 
dt 



= Hd + Vi- Tij ■ £,j 



where Hd = — v • f — dTr[T'r'^]. If c? = 0, it corresponds 
to Ito prescription for the definition of dQ. d ^ 1/2 since 
we assume that stochastic integration in the definition 
of dQ is not in Stratonovich way. f is given by Eq.®. 
Therefore, average heat dissipation rate is changed to 



hd{t) 



dv{~v ■ {' ~ dTr[tr^]}P{v, t) 



(32) 



d-v 



-dTr[TT^] P{t) 



(33) 



The average heat dissipation in equilibrium steady state 
must vanish: 

ftd(oo) = (b • v)e + T{2d - l){Tr[E])e = (34) 

The generalized Einstein relation is changed to 

Eq.Q and Eq.jS^. (35) 

Ea. H18|l still holds without any change. Substitution 
of Pe into Eq. ifT^ leads to 

(b-v), =0. 

Therefore, the generalized Einstein relation can be rede- 
fined to 



Eq.® and (b • v)e = (Tr[S])e = 0. 



(36) 



-^,^,{{r^^),,p}-^d{g^ + n)P}■ 



The last equality in the above equation means that 
the diffusion coefficient of the Fokker-Planck equation. 
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Eq.(|HJ, becomes traceless on average in an equilibrium 
steady state. From Ea. (|32|l . both frictional dissipation 
and heat absorption by fluctuation vanish in the equihb- 
rium steady state since (v-f')e — 0! This is unphysical in 
dissipative systems. Therefore, Stratonovich prescription 
is the unique physical choice. 

IX. CONCLUSIONS AND REMARKS 

In this manuscript, we have provided quantitative 
mesoscopic non-equilibrium thermodynamics of Brown- 
ian particles under both multiplicative noise and feed- 
back control by an external agent. The dynamics of the 
Brownian particles is described by a Langevin equation 
with the multiplicative noise and the feedback control 
by non-conservative force fleld. There is ambiguity in 
stochastic integration prescription of the Langevin equa- 
tion due to the multiplicative noise. However, such am- 
biguity can be removed by proposing a generalized Ein- 
stein relation to guarantee an equilibrium steady state 
in a closed system: the corresponding Fokker-Planck 
equation has no ambiguity. Statistical properties of the 
Langevin equation is described unambiguously. Then, 
how does one construct thermodynamics without such 
prescription ambiguity? Once heat is defined, work and 
entropy production are well defined from energy balance 
and entropy balance. Thus, we focus on how to define 
heat dissipated from the particles to their surrounding. 
The heat is the energy dissipation of the work done by 
contact forces between the particles and their surround- 
ing solvent molecules along the position space trajecto- 



ries of the particles. There are two ambiguities in the 
definition of heat. First, the contact force between the 
particles and their surrounding depends on the stochastic 
integration prescription involved in the Langevin equa- 
tion. Such ambiguity is removed by the Einstein relation. 
Second, the stochastic integration along the trajectories 
of the particles involved in the calculation of the work 
done by the contact forces needs to be prescribed. The 
Stratonovich prescription is shown to be the unique phys- 
ical choice. 

We remark that since both Fokker-Planck equation 
Eq.® and the mesoscopic heat equation Eq.Q are ex- 
pressed in terms of diffusion coefficient VT^ and inde- 
pendent to the integration prescription of the Langevin 
equation, one can numerically or analytically predict all 
the thermodynamic quantities by measuring the diffusion 
coefficient without any mathematical ambiguity. 

Finally, we gives a comment on the link to fluctuation 
theorems and Jarzynski equality, which have been stud- 
ied on Brownian systems with a linear friction, where the 
thermal noise is not multiplicative. The proposed ther- 
modynamics in this manuscript shows the possibility to 
extend the applicability of the fluctuation theorems and 
Jarzynski equality to the Brownian systems with multi- 
plicative noise 0,11 HHHIHIllllllIlllillilSlill 
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